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Abstract. Let W be the complex reflection group & n x (Z/eZ)™. In the author's 
previous paper [SI], Hall-Littlewood functions associated to W were introduced. In 
the special case where W is a Weyl group of type B n , they are closely related to Green 
polynomials of finite classical groups. In this paper, we introduce a two variables 
version of the above Hall-Littlewood functions, as a generalization of Macdonald 
functions associated to symmetric groups. A generalization of Macdonald operators 
is also constructed, and we characterize such functions by making use of Macdonald 
operators, assuming a certain conjecture. 



0. Introduction 

Macdonald functions P\(x;q,t), which were introduced by I.G. Macdonald [M2] 
in 1987, are two variables versions of Hall-Littlewood functions P\(x;t). Those Hall- 
Littlewood functions and Macdonald functions are parametrized by partitions A of 
n. Since partitions of n parameterize irreducible characters of the symmetric group 
& n , we may say that these functions are associated to symmetric groups. On the 
other hand, Hall-Littlewood functions are closely related to Green polynomials of a 
finite general linear group GL n (¥ q ). In this direction, partitions A of n occur as 
unipotent classes of GL n (¥ q ). Unipotent classes of other finite classical groups such 
as Sp2n{^ q ), 5 , 2n +i(lFq) have more complicated patterns. Lusztig introduced in [L2] 
(unipotent) symbols, as a generalization of the notion of partitions, to describe such 
unipotent classes in connection with Springer representations of Weyl groups. He also 
introduced in [LI] a notion of symbols to parameterize unipotent characters of finite 
classical groups. 

In [SI], the author constructed Hall-Littlewood functions associated to complex 
reflection groups W ~ & n k (Z/eZ)™. In [S2], [S3], some related topics are discussed. 
Our Hall-Littlewood functions are parametrized by e-tuples of partitions (which pa- 
rameterize irreducible characters of W), or rather by various types of e-symbols. In the 
case where e = 2, W is the Weyl group of type B n . In this case, Hall-Littlewood func- 
tions attached to unipotent symbols are closely related to Green functions of Sp2 n {^q) 
or S02n+i(^q)- It is also expected that our Hall-Littlewood functions attached to 
symbols have some connection with unipotent characters. 

l 
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This paper is an attempt to generalize Hall-Littlewood functions P^(x; t) (where A 
is an e-symbol) to the two variables version Pj[(x; q, t), just as in the case of P\(x; q, t). 
We call such functions Pj[(x; q, t) Macdonald functions associated to W. In the case of 
original Macdonald functions, they are characterized as simultaneous eigenfunctions 
of various Macdonald operators. We also construct Macdonald operators having (con- 
jecturally) good properties. However, we note that our construction of Macdonald 
operators works only for a special type of symbols (in the case where e = 2, this is 
exactly the symbols used to parameterize unipotent characters), though Macdonald 
functions can be constructed for any type of symbols. In the case of original Macdon- 
ald operators, the representation matrix with respect to the basis of Schur functions 
is a triangular matrix, with distinct eigenvalues. In our case, the matrix of Macdonald 
operators turns out to be a block triangular matrix, where the blocks correspond to 
families of symbols. One can conjecture that the matrices appearing in the diago- 
nal blocks have no common eigenvalues. Assuming this conjecture, we show that the 
Macdonald operator characterizes Macdonald functions, not as eigenfunction, but as 
a unique solution of linear systems attached to the above diagonal blocks. 

The properties of Macdonald functions discussed in this paper are just a part of 
those established for the original Macdonald functions. We hope to discuss more about 
them in a subsequent paper. 



1. Symmetric functions with two parameters 

1.1. An e-tuple of partitions a = (a^°\ . . . , a* 6-1 )) is called an e-partition. We 
define the size \a\ of a by \a\ = Ylh^o \ a ^\i where \a^\ is the size of the partition 
a ( k ). For a partition a : ct\ > a2 > • • • > at > 0, let 1(a) be the number of non-zero 
parts afe. We denote by V n the set of partitions of n, and V n , e the set of e-partitions 
of size n. Let W be the complex reflection group & n x (Z/eZ) n . Then the set of 
conjugacy classes in W is in one to one correspondence with the set V n ,e- 

Let us fix a sequence of positive integers m = (mo, . . . , m e _i), and consider inde- 
terminates xf^ (0 < k < e — 1,1 < j < nik)- We denote by x = x m the whole variables 

(x^), and also denote by x^ the variables x^\ . . . ,Xml- Let ( be a primitive e-th 
root of unity in C. For each integer r > 1 and i such that < i < e — 1, put 

e-l 
3=0 

where p r (x^) denotes the r-th power sum symmetric function with respect to the 
variables x^\ We put pi l \x) = 1 for r = 0. For an e-partition ct = (a^°\ . . . , a* 6 " 1 )) 
with : a[ k ^ > ■ ■ ■ > alnl, we define a function p a (x) by 

e-l m k 

p a {x) = \{\{p%{x). 

k=0j=l 3 
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Next, we define the Schur function s a (x) and monomial symmetric functions 
m a (x) associated to ex by 

e-1 e-1 

s <x(x) = JJ s a ( k) (x {k) ), m a (x) = Y[ m aW (x {k) ), 

k=0 k=0 

where s a ( k )(x^) (resp. m a (k)(x^ ) denotes the usual Schur function (resp. monomial 
symmetric function) associated to the partition with respect to the variables 
x ( k \ These are the symmetric functions associated to complex reflection groups W ~ 
& n ix (Z/eZ) n , as given in [Ml, Appendix B]. 



(*) J k h& mk 

Xm k \ 



1.2. Put 6 m = e mo x • • • x & me _ 1 . We denote by S m = ® e k J Z[x[ h \ . . . 
the ring of symmetric polynomials (with respect to <5 m ) with variables x = {x^). S m 
has a structure of a graded ring S m = ^ i>0 ^ % m , where E l m consists of homogeneous 
symmetric polynomials of degree i, together with the zero polynomial. We consider 
the inverse limit 

3* = lim 

m 

with respect to homomorphisms p m ' jm : S^, — > E. l m , where m' = (m' Q , . . . ,m' e _^) with 
m' k = ffifc + I for some integer / > 0, and p m ',m is induced from the homomorphism 
fc Z[x[ k \ . . . , x[ k }] — > fc Z[x[ k \ . . . , x$ k ] given by sending xf ) to for « > m fc , and 

leaving the other xj^ invariant. S = @ i>0 H* is called the space of symmetric func- 
tions. Schur functions s a (x) with infinitely many variables x^ k \x^ ■ ■ • are regarded 
as elements in E n with n = \a\, and the set {s a (x) \ ex e "P n ,e} forms a Z-basis of 
S n . Similarly, {m Q (a;) | ex £ V n , e } gives a Z-basis of E n . Put S c = C <E> S. Then 
{Pal^) I ck £ ^n.e} gives rise to a basis of H c . 

1.3. Let g,t be independent indeterminates and let F = C(q,t) be the field of 
rational functions in q,t. We consider the F-algebra of symmetric functions = 
F ®z S with coefficients in F. Let a = (a*- -*, . . . , a^ 6-1 * 1 ) be an e-partition. For each 
partition : a[ k ^ > >•••■, put 



w (?,*)= n - — ^w"- 



We then define z a (q, t) E F by 

e-1 

(1.3.1) z a (q,t) = z a Y[z aW (q,t), 

k=0 

where z a is the order of the centralizer of w a in W (a representative of the conjugacy 
class of W corresponding to ex e V n , e )- Explicitly, z a is given as follows. For ex G "P n ,e, 
put 1(a) = Efc=^(« W )- For a partition a = (l ni , 2" 2 , . . . ), put z a = Ui>i inin i-- 
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We define a sesquilinear form on E F by 
(1.3.2) (p a , pp) = 5 ai f3Z a (q, t) 

for a, /3 e V n>e . Let x = (xf^), y = (yf^) (0 < k < e — 1) be two sequences of infinitely 
many variables, and we define an infinite product of x and y by 

e-l oo oo 1 _ tx (k-r-l)(k) qr 



(1.3.3) U(x,y;q,t) = Y{}J JJ 



(k—r) (k) r 
k=0 i,j=l r=0 1 — X i Vj Q 

e-l oo oo i _ , (fe) (fe+r+1) r 

nTT TT 1 tx » 1 
11 11 1 _ (fc) ..(fc+r) . • 

(Here the upper indices of the variables in the formula should be read mod e). Note 
that in the case where q — 0, the product Il(a:, y; g, t) reduces to the product Q(x, y\ t) 
introduced in [SI, 2.5], (or rather [S2, (5.7.1)], see the remark there). 



Lemma 1.4. U(x,y;q, t) has the following expansion. 

n(x, y; q,t) = ^2 z a (q, t)~ 1 p a (x)p a (y) 

where a runs over all the e-partitions of any size. 

Proof. Taking the log on both sides of the first formula of (1.3.3), 
log II(a;, y; q, t) 

OO OO s 1 m 

k i,j r=0 m=l 

By making use of the equation 



e 

a=0 



the above formula can be written as 

e-l 



-E(c*r fc, )° = ^, 



iogn(x, 2/;g ,t) = x:EE E {^c ar c a(fc - r) r a *'(x?- r M*' ) ? r ) m 

a=0 m>l r>0 k,k',i,j ^ 

_ _^_^a(r+l)^a(fc-r-l)^-ofc'/ a .(fc-r-l) (fc') ? r\m 1 

em ' J J 
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It follows that 

a=0 m>l r>0 k,k',i,j 

e ~l i i /aim 

1 1 - C * > a fc>_ofc'/ (fc)„,(fc')N 



e-1 



EE E — • f^c afe c a *>rM } r 

^— ' ^— ' em 1 — r a (7 m ■> 

a=0 m>l k,k',i,j 



e—1 oo 



a=0 m=l b ^ 



Hence we have 



(1 1 — ^"y-™ — 

n(x,y; q ,t) = J] II ex H ^ • T37^^ a) (-rf(y) 



a=0 m=l 



□ 



1.5. For a fixed y| , we define a function g^ i± (x; q, t) as the coefficient of (yj ) m 

in 

1 _ -/- ( fe T»*Tl) (fe) r 

(i-"> nn r%X g -EA^tfr 

i r>0 1 x i f/j V/ m>0 

and put, for each a = {otf^) G P n ,e, 

9*x,±(x; q,t) = Y[g (k l) ■ 

Oi- ,zt 

Then we have 

(1.5.2) U(x,y;q,t) = ^2g a:+ (x;q,t)m a (y) = ^2m a (x)g a -(y;q,t). 

In fact, by comparing the first formula of (1.3.3) and (1.5.1), we have 
H(x,y;q,t) = H £ g% + (x; q, t){yf 

= ^y«,+ (x; q,t)m a (y). 

a 

This shows the first equality. If we compare the second formula of (1.3.3) and (1.5.1) 
by replacing x and y, the second equality is obtained in a similar way. 



6 T. SHOJI 

Now by using a similar argument as in [Ml, VI, 2.7], we see that 
(1.5.3) (9a,+ ( x ^Q^)^ m fi{ x )) = ( m Ux),9f3,-(x;q,t)} = <J„ >/3 . 

In particular, the functions g aj ±(x; q,t) form a basis of H_p dual to m a . Hence 
{g n {x] q,t) | n > 0} are algebraically independent over F, and — F[g±, g%, . . .]. 

The following lemma can be proved in a similar way as [Ml, VI, 2.13] by using 
(1.5.2) and (1.5.3). 

Lemma 1.6. Let E ± : E F —> E F be two F-linear operators. Then the following 
conditions are equivalent. 

(i) (E+f, g) = (/, E~g)_ for any f,geZ F 

(ii) E+H(x, y; q, t) = E~U(x,y;q,t), where the suffix x indicates the action of E ± on 
the x variables, and similarly for y. 

1.7. We shall give an explicit form of the function g a ,±(x; q,t). For this, we 
prepare some notation. For /i = (/i , . . . , // e -i) £ Z> , P u ^ 

e - 1 ^ a A k Ta) , (fc=F<>=Fl) efj-l) 

/aw)=nn ' „ q ■ 

a=0j=l H 

Let M m be the set of sequences /x = . . . ) such that fj,® £ Z> and that 

J2i = m. For fi = (/i!, fi 2 , . . . , //«,) G Z| , put n(^) = J2j(J ~ T ^en 

Proposition 1.8. For each m > 0, we have 

(i.8.i) &(*;?,*) = E II/^( a; ;9'*)? BOiW) - 

Proof. By [Ml, I, §2, Ex. 5], the following identity of formal power series is known. 

1 — bq' l t \ f T~T a ~ bq l ~ l \ m 



i=0 ^ m>0 v i=l ^ 

Substituting this into 



A TT 1 ~ ^T^V; _ TT TT 1 - txf^ y(f e + a 

with a = a;f :=Fa ' ) , 6 = txf TaTl \ t = q a y, q = q e , we see that 

e ~ l 00 ^ (fe=Fa) . (fe=Fa=Fl)_e(j-l) 
a=0Ma=0j=l y 

= E /^(^(z.o^V" 1 - 
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It follows that 

i>lr>0 1 X j i/j V/ m>0/xG.M m i>l 

By comparing this with (1.5.1), we obtain the required formula. □ 

Remark 1.9. g^±(x;0,t) coincides with the function q^±(x;t) introduced in 
[SI, 2.2]. By using a similar, but much simpler arguments as above, one obtains an 
alternative expression of q^ ± (x;t) as follows. 

where (5 M is the stabilizer of /x in @ m . (Here we are considering finite variables 
x[ k \x\ kTl ^ (1 < i < m), and © m acts on both variables). 

1.10. The notion of symbols was introduced in [SI]. (Although a more general 
setting was discussed in [S2], we do not use it in the discussion below. We remark that 
similar symbols were also considered by G. Malle in [Ma]). Let m = (mo, . . . , m e -i) be 
as before. We denote by = Z° ,0 (m) the set of e-partitions a = (a^°\ . . . , a 6 " 1 )) G 
V n>e such that each is written ( as an element in Z mk ) in the form : a[ k ^ > 
• • • > ami — 0- We express a as a = (oi^) in matrix form. Let us fix integers 
r > s > and define an e-partition A = A°(m, s, r) = (A^°\ . . . , A^'^) as follows. 

(1.10.1) A (0) : (m -l)r > ■■■2r >r > 0, 

A (i) : s + {mi - l)r > • • • > s + 2r > s + r > s 

for % — 0, . . . , e — 1. We denote by Z% s = Z% s (m) the set of e-partitions of the form 
A = a + A , where a. E Z®'° and the sum is taken entry-wise. We write A = A(a) if 
A = a+A°, and call it the e-symbol of type (r, s) corresponding to a. We often denote 

the symbol A = (A<-°\ . . . , A^) in the form A = (Af) with /1« : ylf ) > • • • > A {k \ 
for k — 0, . . . , e — 1. 

Put m' = (m + 1, . . . , m e _! + 1), and define a shift operation Z% s (m) — >■ Z^ s (m') 
by associating A' = (A' , . . . , ^' e _i) G Z^ s (m) to A = (A , . . . , A e _i) G Z£' s (m), where 
yl = (A + r) U {0}, and A fc = (A k + r) U {s} for A; = 0, . . . , e - 1. In other words, for 
A = A(ac), A' is obtained as A' = a. + A°(m / , s, r), where a is regarded as an element 
of Z°'°(m / ) by adding in the entries of a. We denote by Z^ s the set of classes in 
LIm' ^n' s ( m ') under the equivalence relation generated by shift operations. Note that 
V n , e coincides with the set Also note that A is regarded as a symbol in Z^ ,s 

with n — 0. 

Two elements A and A' in Z£ s are said to be similar, and are written as A ~ A', 
if there exist representatives in Z% s (m) such that all the entries of them coincide with 
multiplicities. The set of symbols which are similar to a fixed symbol is called a family 
in Z^. 
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We define a function a : Z^f — > Z> , for yl e Z% s , by 

(1.10.2) a(A) = min{A,A'}- ^ min-Jjit, //}. 

The function a on Z£ s is invariant under the shift operation, and it induces a function 
a on Z^ s . Clearly, the a- function takes a constant value on each family in Z^ s . We 
regard the a-function as a function on Z%° by using the bijection Z%° ~ Z% s . 

1.11. Hall-Littlewood functions P^(x;t) and Q^(^;t) attached to symbols A 
were introduced in [SI]. We shall now construct a two parameter version of Hall- 
Littlewood functions. Let us introduce a total order cx -< (3 on Z%° such that a(ct) > 
a(f3) whenever cx -< f3 and that each family in Z^° forms an interval. 

The following proposition is easily obtained by a similar argument as in Remark 
4.9 in [SI] (i.e., a generalization of Gram-Schmidt orthogonalization process) if one 
notices that n(a;, y;0,t) coincides with il(x,y;t) in [SI, 2.5]. 

Proposition 1.12. There exists a unique function P^(x;q,t) E E F for A G Z^ s 

satisfying the following two properties. 

(i) P A (x; q,t) for A = A(ct) can be expressed in terms of sp(x) as 

with u^pE F ' , where u^p = unless (3 -< cx and (3 ^ ex. 

(ii) (PX, PX>) = unless A ~ A'. 

We then define Q A (x; q, t) as the dual of P A { X \ t), i-e., by the property that 

(PX,Q a ,} = (Q a ,P a >}= 6 aa>- 

PX(x;q,t), Q A (x;q,t) are called the Macdonald functions associated to complex re- 
flection groups W (with respect to symbols in Z^ s ). 

Remark 1.13. (i) The orthogonality relations of Macdonald functions given above 
imply, by [Ml, VI, 2.7], that 

(1.13.1) U(x, y; q,t) = Y, P X& Q, t)Q~ A (v\ 9, *) 

A 

= ^Q+(x;g,t)P A ( 2 /;g,t). 

A 

(ii) In the case where q = 0, the scalar product given in (1.3.2) coincides with the 
one given in [SI, 4.7]. Then by Proposition 4.8 in [SI], one sees that 

(1.13.2) PX(x; 0, t) = PX(x, t), Q A {x; 0, t) = Q±(x; t), 

where the right hand sides are the Hall-Littlewood functions defined in [SI]. 
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(iii) In the case where q — t, the scalar product in (1.3.2) coincides with the usual 
scalar product on the space Sq, where the Schur functions form an orthonormal basis 
of it. Hence Proposition 1.12 implies that 

(1.13.3) Pi {a) (x;t,t) = Q% a) (x;t,t) = s a (x). 



2. Macdonald operators 

2.1. The original Macdonald functions related to symmetric groups are character- 
ized as the simultaneous eigenfunctions of Macdonald operators (see [Ml, VI]). In this 
section, we shall construct certain operators which can be viewed as a generalization 
of Macdonald operators to the case of W. Here we restrict ourselves to the case where 
symbols are of the type (r, s) with r = 1 and s = 0. (We note that the arguments 
in this section can not be applied to other types of symbols. See Remark 2.9.) In 
particular, A = S, where S = (8^°\ . . . , 5 <e ~ 1 )) with 5^ = (m k — 1, . . . , 1, 0). Hence, 
in the case where e = 2 (i.e., W is the Weyl group of type B n ) with mi = m + 1, these 
symbols are exactly the ones used to parameterize unipotent characters of finite clas- 
sical groups Sp2n(^ q ) or S0 2n +i by Lusztig [LI]. Each family T in Z^'° contains 
a unique element Ajr = (A^) with the property 

(2.1.1) A? > A? >■■■> A { r 1] > 4 0) > 4 1} > • • • • 

Such an element is called a special symbol associated to the family T . The set of 
families is in bijection with the set of special symbols. Special symbols are regarded 
as partitions of N = £ Af ] by (2.1.1). 

We shall define a partial order on the set of families in Z]f . Let T and T 1 
be families in Z^'° and A^, A?* be special symbols corresponding to them. We put 
T < T' if Ajr < Ajri with respect to the dominance order on Vn- Recall that for 
A = (Aj),/i = (/ij) G Vn, the dominance order A < /i is defined by the condition that 

k k 
5^A,<^/i i? (l<k<^2mj). 

i=l i=l j 

We define a partial order on Z^'° by inheriting the partial order on the set of families. 
For A = (A;) G V N , put 

n(A) = J> - 1)A 4 . 
i>\ 

Then, for each A in a family J 7 , the value a(A) is given as a(A) = n(Ajr) — n(A°), 
where A? is regarded as an element in Vm- In particular, we have a(A) > a(A') if 
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A < A' . As before, by using the bijection ~ Z]f , we consider the partial order 
on Z®'°, which will be denoted by the same symbol. 

2.2. In order to construct Macdonald operators, we shall start with finitely many 
variables x = x m . We consider the expansion of U(x,y;q, t) in the case of finitely 
many variables. Assume that x = (xf^) = x m is as in 1.2 and put E m) p — F <S>z S m . 
Let us denote by V m the set of e-partitions ex = (ot^) such that l(a^) < m k . Then 
ma{ x ) — unless ol G V m , and those non-zero m a (x) form a basis of S m t p. The 
same is true for Schur functions. Also by a similar argument as in [Ml] we see that 
g a (x; q, t) such that a G V m form an F-basis of S m i?. 

Now by substituting x^ = = for j > m k , we have a finite version of (1.5.2), 
i.e., for x = x m , y = y m , we have 

(2.2.1) Tl(x,y;q,t) = ^ g a>+ (x; q,t)m a (y) = m a (x)g a -(y;q,t). 

aev m ocev m 

This enables us to define a scalar product on E. mj p by 

(2.2.2) (g a ,+,rn f3 } = (m a ,g P -) = 5 aj(3 . 

We now consider the restriction of the functions to E m ,F- By Proposition 1.12, 
one sees that {P^a) I a ^ ^m} form a basis of H m ^. Moreover, the finite variables 
version of Proposition 1.12 holds, and P^ G Ep is obtained as the limit of P^ G S mi ^ 
determined by these properties. 

2.3. Let 

/ 

T = J(m) = {i = : | e Z e | 1 < i k < m k }. 

Ve-1, 

For each i G X and u G F, we define an F-linear operator Tj^ : — > F[x] by 
T^j/ = /', where /' is a polynomial obtained from / by replacing the variables xf^ 

by ux^ij^ for k — 0, . . . , e — 1. (Here we understand that i e = i ). More generally, for 
each r such that 1 < r < Mi = min^m*;}, we define X r as the set of J = {ii, . . . , i r } 
consisting of i k G X such that any two i& have no common entries (i.e., ij — i& does not 
contain entries for each j ^ k as vectors in Z e ). Then we define, for each J G X r , 
an operator T^j : — > by = YYk=i^u\ ■ Note that in the product 
commute with each other, and so T^j does not depend on the order of the product. 
Let Z = Z(m) be the set of sequences (3 = {pf^) (0 < k < e — 1, 1 < j < m^) 

with [3^ G Z> . For each (3 G Z, we denote by [/3] the element in Z obtained from (3 
by permuting the entries inside each row, so that each row is arranged in decreasing 
order. We often regard (3 as a matrix, and denote its k-th. row by (3^ k \ Then the set 
J is regarded as a subset of the set of indices {(k, j) \ < k < e — 1,1 < j < m k } of 
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We put, for each (3 E Z and J e X r , 

(5 m acts naturally on Z and on I r , respectively, and this pairing is (5 m - invariant. We 
also note that the action of (5 m on X r is transitive. 

The operation of T^j on x = (xf^) also induces an action (3 h- > /3 J± on Z by 
permuting the entries of /3 so that T^jX^ = q^ J ">x^ J ±, where, as usual, x 13 denotes 

the monomial riifc^i / 4 ■ F° r eacn /3 E Z, we define a function a ( g(x) by 

We now define, for each 1 < r < Mi, an F-linear operator D±(q,t) on by 

(2.3.1) £>£(g,t) = ^(x)- 1 E e H E x^W^i^W'^Tjj. 

we 6 m J&Xr 

Then D±(q,t) can be written as 

(2.3.2) = 



Jex r 



with 



a tf (x) T t)t7 a tf (x) 



(2.3.3) = t r(r-l)/2 JJ JJ "/ 



(*) „(*) ' 

("fcj')eJ 



k=0 {k,i)£J X i X j 



where we write J = . . . , i r }, and take (k =F 1, f) £ ia if G i a for a = 1, . . . , r. 
The formulas (2.3.2) and (2.3.3) are the analogue of (3.4) r and (3.5) r in [M, VI, 3]. 
First we show that 



Lemma 2.4. (i) For a e V m , we have 

D r ± (q,t)m a (x) = EE ^V^G^-aM, 

where f3 & Z runs over all the row permutations of a. 
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(ii) For a. G V m , we have, 

D r ± (q,t)m a (x) = b a%( q > m /3(^) 

u>i£/j 6^g(<?, t) G F 7 where b r ^(q,t) = unless (3 ~ en or /3 < ck. In particular, 
D± is an operator on the space S mi i?. 

Proof. For each /3 G we have 

D^y 3 = a^)- 1 £ e( Wl )^t <tUl(5) ' J> 9 <AJ ^ (/3+Wl(5)) ' 7± . 

If we replace (3 by u»2(/3) for w 2 G ©m and put w 2 = wiw, the term (/3 + tfi(<5))j± 
(resp. ((3, J) ) is replaced by Wi((w(f3) + <5)j/±) (resp. (w((3), J') ), respectively, with 
J' = Wi (J). It follows that for a G Z%°, we have 

D r ± (q,t)m a {x) = l&^l" 1 as(x)" 1 ^ e ( w ±) 

x ^ t{S,J') q {^),J') x wi((w(cx)+S) JI± ) 

This proves (i). 

Next we show (ii). Since S = A by our assumption, a + <5 coincides with the 
symbol A(a) for a G Z%°. We note that if w ^ 1, then the symbol + (5 belongs 
to a family strictly smaller than the family containing ex.. On the other hand, if w = 1, 
(ct + d)j± is obtained from the symbol ot + 5 by permuting some entries, and S( a+ s) J± s 
coincides with ±s 7 , where 7 + S is obtained from (o: + S)j± by rearranging the rows 
in decreasing order. It follows that 7 + S is contained in the same family as a + 6. 
Hence, for (3 G Z®'° in the expression of (ii), we see that (3 < a. if w 7^ 1 and (3 ~ a. if 
iu = 1. □ 



Next we show 

Lemma 2.5. T/ie operators D r ± are adjoint each other, i.e., we have 

(2.5.1) (£>;/, (?) = (/, , (/, </ G S m , F ). 
Proof. By Lemma 1.6, (2.5.1) is equivalent to the formula 

(2.5.2) n- 1 ^;) ji = rr 1 ^ ^n. 
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But for J G l r , we have 

1 - xfyf 



n-ro^nn n 



1 _ , (k) (fe+i) ' 
^=0 j>i (k,i)ej 1 tx i yj 

e-1 i _ (fc) (*0 

n-'(w=nn ii ; 

fc=o i>i (fcj)eJ 1 tx i 



It follows that both of U' 1 X U and n _1 (Z}1) ?/ il are independent of q. Hence in 
the proof of (2.5.2), we may assume that q — t. In other words, we have only to prove 
(2.5.1) under the assumption that q — t. 
Now assume that q — t. Since 

J"± ( X W ( S ) f) — x w (S)j±^{w(S),J)j^± r 

for any polynomial / G F[x], we have 

Dl(t,t)f = a s 1 J2 T t ± jM)- 

Jei r 

It follows that for any a G Z°'°, 

D r ± (t,t)s a = a s x T tA a <*+s) 

Jei r 

As before, S( a+ a) J± _a coincides with ±S/3, where (3 + 8 = [(ex. + 6)j±] (under the 
notation in 2.3). Now in the case where q = t, {s a (x) | ex G V m } is an orthonormal 
basis of S m)F . It follows that 

(2.5.3) (Dl(t,t)s a , S(3 ) = J2tJ + t {a+S ' J \ 

j 

where J runs over all the elements in X r such that [(ex. + 8)j+] coincides with (3 + 8, 
and Ej = (-lyO) with w G 6 m such that [(a + S)j+] = w((cx + 6)j+). But if 
(3 + 6 = w((cx + S) J+ ), we have ex + 8 = w- l (((3 + = [((3 + with 

J' = w(J). Also in this case, 

(/3 + 8, J') = (w(cx + 6)j,+, J') = (w(a + 8), J') = {a + S,J). 

Since e J+ = ej>-, we see that the right hand side of (2.5.3) is equal to 
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where J' G X r runs over all the elements such that [(/3 + 8)jtJ\ = et + 5. Clearly this 
coincides with (s a , D r _{t, t)sp). So the lemma is proved. □ 



2.6. We fix a total order -< on Z®'° as in 1.11, so that it is compatible with 
the partial order <. Let B r ± = (6^) be the matrix consisting of the coefficients in 
the formula in Lemma 2.4 (ii) with respect to the total order -<. We consider B± 
as a block matrix with respect to the equivalence relation ex. ~ (3, and denote it as 
{B^p,), where B 1 ^, is the submatrix of B± corresponding to the families J 7 , T' . Then 
Lemma 2.4 (ii) implies that B r ± is lower triangular as a block matrix. We consider the 
Macdonald functions P A constructed via -<. The following result shows that the set of 
Macdonald functions attached to symbols in a fixed family behaves as an eigenfunction 
for Macdonald operators, where the eigenvalues should be replaced by the diagonal 
blocks B 1 ^ of B±. 

Proposition 2.7. Let P A (x;q,t) G ^ be Macdonald functions attached to A = 
A(ct). Then we have 

D r p± _ST iT,± p ± 

where the coefficients b r ^ are the same as in Lemma 2.4 (ii)- 
Proof. By Proposition 1.12, P^ can be written as 

Pa = m cc + Yl u 'a,i3 m P 
with u' a j3 G F. It follows, by Lemma 2.4 (ii), that one can write as 

A'^A,A'^A 

Hence, for each A' such that A' -< A and that A' ^ A, we have 

{D r + php- A ) = ci A , 

On the other hand thanks to Lemma 2.5, we have 

(D r + PX,P A ,} = (Pl,D r _P A/ } = 

since D r _P~, is a linear combination of P~„, where A" ~ A' or A" -< A'. It follows 
that c + A A , = and the proposition holds for the + case. The — case is similar. □ 

In view of Proposition 2.7, it is important to know the diagonal part of B±. By 
lemma 2.4, the matrix B^ T is described as follows. 
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Lemma 2.8. For ct, (3 £ Z®'° such that (3 ~ ct, we have 
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Jei r 
[Aj±]=A((3) 

where A = ct + 5 G Z*'° and Ea,j± = (— 1)'^ for w G & m such that [Aj±] = w(Aj±). 

Remark 2.9. The results in this section work only for a special type of symbols. It 
seems to be difficult to extend the definition of Macdonald operators in (2.3.1) directly 
to a more general case. A naive idea for the general situation is to replace S by A in the 
definition (2.3.1). Then one gets some operator related to the symbols associated with 
A . However, the thus obtained operator does not preserve the set of polynomials in x, 
since it involves the factor a yl o(a;)~ 1 . If one leaves the denominator a$(x) unchanged, 
and replaces S in all other places, then the operator preserves polynomials, but it does 
not preserve the degree of them, and is not so useful. 

3. A CHARACTERIZATION OF MACDONALD FUNCTIONS 

3.1. We write the operator D± as D r m ± to indicate the dependence on m. The 
operators D r m± are not compatible with the restriction homomorphisms p m ', m . In 
the case where r = 1, one can modify D] n± as discussed in [Ml], so that they are 
compatible with p m ' jm . Let us define an operator E^ = E^(q,t) on H mj i? by 

(3.1.1) Ei = t- M D^ ± -J2t {S ' i) ~ M - 

iei 

We show the following lemma. 

Lemma 3.2. The operators E^ are compatible with p m > tm , i.e., we have 

Pm',m ° = E± O p m , m 

for m' = (m + 1, . . . ,m e -i + 1). 

Proof. Let us define another operator E^ : S m <F — > E m F by 

^ = t- M D^ ± -^t™- M a?T*a 8 . 
iei 

Then for each ct G V m , we have 

(3.2.1) E±m a = J^T,^ ~ l)t- Eik s { p +S)l± s, 

p iei 

where (3 G Z runs over all the row permutations of ct, and i = (iq, . . . , i e -i). In 
fact, by applying [Ml, VI, 4] one can write m a = Ylf3 s P w hh (3 as above. Since 
a s lT i^i a s s f3 = S(/3+5) i± -5, we obtain (3.2.1). 
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We claim that E^ is compatible with p m >, m , i-e., 
(3.2.2) p m , >m o £±, = E± o Pm , >m . 

Recall that the map p m ' im : S m / ;F — > S m ^ is defined by substituting a^+i = for 
k = 0, . . . , e - 1. Take ck G Z°'°(m) and let a' G Z°'°(m') be the element obtained 
by adding 0's to the last part of a. We consider the expression of E^m^ as given in 
(3.2.1). Let d' be the element for m' corresponding to d for m, and take (3' G Z(m'). 
We note that S(/3'+a') i± -5' goes to zero under p m ' )in if there exists some fc such that 

/3<J> +1 ^ for (3' = (!3f ] ). In fact, if we write (3' + 6' = ( 7 f } ), then 7 f ) > for 

j < nik- Hence if P^l+i ^ f° r some k, then (f3' + S')i± = (7'^) contains a row 7'^ ^ 
whose entries are all non-zero, and so Srp' +S '\ l± _ S ' goes to zero. 

It follows that in the expression of E^,m a i in (3.2.1), we may only consider (a 
row permutation of ex.' ) such that the last column consists of zeros. One can embed 
Z(m) into Z(va!) by adding to the last part of (3 G Z(m). Then those (3 1 are 
identified, under the embedding Z® ,0 (m) Z®'°(m'), with a row permutation /3 of a. 
Now X(m) is also embedded into X(m') in the same way. Take i G X(m') such that 
i G" X(m). If i is not equal to ii = t (m + 1, . . . , m e _i + 1), then S(p> + g>) i± _g> goes to 
zero under p m ' jm by the same reason as before. If i = ii, then ((3', i) = 0. In any case, 
such i does not give a contribution, and we may only consider i G X(m) in (3.2.1). 
Hence (3^2.2) holds. 

Let H± be the coefficient matrix of E^m a in terms of mp. Then by Lemma 2.4 
(ii), H± can be expressed as a block matrix H± = (H^^,), where T , = unless 
T = T' or T' < T . Then by comparing (3.2.1) with Lemma 2.4 (i) on the diagonal 
parts, we see that 

iei 

On the other hand, if we write T = (/i^) a ,/3g^, Proposition 2.7 together with 
(3.1.1) implies that 

F±P± - h ± P ± 

But by (3.2.2), the matrix T does not depend on the shift operation under m' — > m. 
This shows that the operator E^ is compatible with p m ', m - The lemma is proved. □ 



3.3. By Lemma 3.2, one can define an operator E ± = E ± (q, t) on Hp as the limit 
of E^. Since E^ satisfies a similar formula as given in Lemma 2.5, the operator E^ 
also satisfies the adjointness property, i.e., we have 

(3.3.1) (E+f,g) = (f,E~g), (f,geZ F ). 
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By Lemma 2.4 (ii), one can write, for each a e V n ^ 
(3.3.2) E ± (q,t)m a (x) = ^ h% p {q,t)m p { 



with h^p{q,t) G F, where h^p(q,t) = unless /3 ~ ck or /3 < a. Let if± = (h^p), 
and write it as a block matrix H± = (H^^,) as in 2.6. 

In the case of symmetric groups, the matrix H± is a triangular matrix, with dis- 
tinct eigenvalues. This property was used to characterize Macdonald functions as 
eigenf unctions of Macdonald operators. As an analogy, it is likely that the following 
property holds for the diagonal parts of the block matrix B±. 

Conjecture A. Let JF, T' be any distinct families in Then the matrices 

and Hp, T , have no common eigenvalues (according to the sign + or — , respectively). 

We have verified the conjecture in the case where e = 2, and n < 5. 

3.4. Before giving a characterization of Macdonald functions in terms of Mac- 
donald operators, we prepare an easy lemma. Let A = (a^) (resp. B = (%)) be a 
square matrix of degree m (resp. n), and let C = (C Q , )i g)i< Qj/ g< n be a block matrix of 
size mn, consisting of blocks C a ,p of size m, defined by 

)A-b a ^I m if (3 = a, 

^ ct (3 — \ 

I _ b a ^I m otherwise. 

We consider a matrix equation AX = XB, where X = (x^) is a m x n matrix of 
unknown variables. Then this equation can be regarded as a system of linear equations 
with respect to the mn variables {:%}, whose coefficient matrix is given by the matrix 
C. Moreover, if B is a triangular matrix, then C is block wise triangular, and so 
detC 7^ if and only if det(A — b a ^ a I m ) ^ for 1 < a < n. Hence we have the 
following lemma. 

Lemma 3.5. Under the above notation, the following are equivalent. 

(i) The matrix equation AX = XB has a unique solution X = 0. 

(ii) detC ^ 0. 

(iii) The matrices A and B have no common eigenvalues. 

We now show the following. 

Theorem 3.6. Suppose that Conjecture A holds. Then the Macdonald functions Pj[ e 
E F are characterized by the following two properties. 

(3.6.1) P% = m a + w %p m fr 

f3<a 



(3.6.2) E±P± = <?P. 



± 

Mm- 



In particular, P^ are determined independently from the choice of the total order -<. 
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Proof. Let {jFj | % e /} be the set of families in Z®'°. We give a total order -< on the 
index set I, according to the total order -< on Z®'°, and write H± as H± = (Hij)ij e j, 
where Hij = Hp. T .. (Since the following discussion is independent of the sign {±}, we 
omit them). Let X = (w^p) be the transition matrix between basis {m a } and {P^} of 
Ep, and write it as X = (Xij). By Proposition 1.12, X is block wise lower triangular, 
with identity diagonal blocks. Moreover, by Proposition 2.7, we see that XHX^ 1 = G, 
where G = (Gij) is a block diagonal matrix with diagonal blocks Gu = Ha. In order 
to prove the theorem, we have only to show the following. 

(3.6.3) Let X = (X^) be a block wise lower triangular matrix, with identity diagonal 
blocks, such that XHX^ 1 = G. Then X is determined uniquely, and X^ = unless 
i = j or Tj < Ti. 

We show (3.6.3). The equation XHX^ 1 = G can be written as 

(3.6.4) HaXij — XijHjj = ^ X ik H k j 

j-<k-<i 

for any pair j -< i. By backwards induction on j, we may assume that X ik are already 
determined for j -< k -< i. Then (3.6.4) determines X^ uniquely, by Conjecture A and 
Lemma 3.5. Now suppose that Tj -ft T^. Again by induction, we may assume that 
Xjfc = unless T k < T{. Since H^j = unless J-j < T k by (3.3.2), we must have 
HaXij — XijHjj = 0. This implies that X^ = by Lemma 3.5, and we obtain (3.6.3). 
Thus the theorem is proved. □ 



Remark 3.7. The Hall-Littlewood function P^(x;t) given in [SI] coincides with 
P^(x; 0, t). Hence it satisfies similar formulas as (3.6.1), (3.6.2). In particular, P^(x; t), 
and so the Kostka functions K^p(x; t) do not depend on the choice of the total order. 
This answers the questions posed in [SI, Remark 4.5, (ii)] and in [GM, Remark 2.4], 
modulo the truth of the conjecture. 

3.8. We give here some examples of the matrices T and Hp T for some small 
rank cases with e = 2. Assume that W is the Weyl group of type C 2 . Then the 
symbols and families are given as follows. 



which correspond, in this order, to the double partitions of 2, 

(2;-), (-;11), (1;1), (11;-), (-; 2) 
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respectively. In the tables below, we express the matrices T , T as Bp, iJjc, since 
they are independent of the sign ±. We have 



= B^ = (t 3 q + tq), B T , 



I q tq 2 
q — tq 
\tq 2 -q 2 



Up to C 5 , only 3-element or 1-element families occur. The Weyl group of type C 6 
contains a unique 10-element family, which is given as follows, 



4 2 0\ /4 2 1\ /4 3 0\ /4 3 1\ /4 3 2 

30 /' \ 2 1 y ' V 2 /' V 1 

4 1 0\ /3 2 0\ /3 2 1\ /3 1 0\ /2 1 
32 M 41 M 40 M 42 M 43 



)>■ 

The corresponding double partitions of 6 are, in this order, as follows. 

(21; 21), (211; 2), (22; 11), (221; 1), (222;-), 
(2; 22), (11; 31), (111; 3), (1; 32), (-;33). 

The matrix Bjr is given by 



Br 



( 


q 


t 2 q 3 





tq 2 


tq 2 


t 3 q 4 








tV\ 


q 








t 2 q 3 


-tq 3 


-tq 





tV 





-tV 


t 2 q 3 








q 


-tq 


-tq 3 


-t 3 q 3 





t 2 q 3 








t 2 q 3 


<? 





tq 2 


tq 2 





-t 3 q 3 


-t 2 q 2 





tq 2 


-t 2 q 2 


-9 2 


^ 2 








-tV 


t 3 q 2 








tq 2 


-q 2 


-t 2 q 2 


tq 2 
















-t 2 q 4 


t 3 q A 





-t 2 q 4 





-t<7 3 








<? 




-t 2 q 2 





t 3 q A 





-tV 


^ 4 





q 







t 2 q 








*v 


-tq 3 





tV 


tq 2 


-9 2 





t 2 q 3 


\t 2 q 3 


-tq 3 











-t 3 q 3 


-tq 3 


, 3 


iV 


o J 



Throughout the above examples, is given by 



H 



,-(2m+l)g t -(2m+l) (j; ~ ^")(1 ~ t m+1 ) 
^ (1-t) 2 



for symbols of the shape m = (to + 1, to), (so, to = 1 for T\^T^ and to = 2 for JF 2 , .F 4 , 
respectively). Note that .B^ is not necessarily symmetric. However, if we put q — t, it 
turns out to be symmetric since D 1 is a self adjoint operator, and the representation 
matrix with respect to the orthonormal basis of Schur functions coincides with the 
diagonal blocks (Bjr). 

3.9. In the case of symmetric groups, Macdonald operators are commuting with 
each other since they are simultaneously diagonalizable. In our case, Proposition 2.7 
shows that D± are simultaneously diagonalizable in the sense of block matrices. So 
they are commuting with each other if and only if the matrices Bj^ are commuting 
with for r = 1, . . . , Mi (for a fixed J 7 ). As the following examples show, one might 
expect that Bj^ are commuting with each other in general. 
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First consider a simple example. Let J-3 = {Ai, A 2 , A 3 } be the 3-element family 
of C 2 as in 3.8. We consider its m times shifts = {A[, A' 2 , A f 3 }, where 

, (x + to, y + m, m — 1, . . . , 0\ 
% \ z + to, to - 1, . . . , / 

for Ai = ( x ^ . Then the matrices B r Tz are given as 

B k = ^ + b 

with 

J' J 

where J G X r runs over the elements of the form J = . . . , ij r } for ij = P^ 1 ) with 
2 < j < m + 1, and J' e X r _! runs over the elements having similar properties. This 
implies that B r Tz are all commuting with for 1 < r < m. 

In the following, we discuss some related results, i.e., we show that when e = 2, 
and q = t, then the operators D r are commuting with each other. First we prepare a 
lemma. (Since we deal with the case where e = 2, we omit the sign ± in the discussion 
below.) 

Lemma 3.10. Assume that e = 2. Then, for each r,r', there exists a bijective map 
ip : X r x X r i — > X r x X r i satisfying the following properties: let J G X r , J 1 G X r i and put 
ip(J, J') = (K, K'). For each a. G Z , we have 

(l) OLjj, = OL K 'K, 

(ii) (a, J) + (a j, J'} = (a, K') + (a*,, . 

Proof. Take J <E X r , J' E X r i. Let Jo be the subset of J consisting of i = (?) such that 
there exists i' = (^) G J' with x = a or y = b, and let J' Q be the subset of J' having 
similar properties. We define an equivalence relation on Jo by connecting i = , i' = 
Q) G J when there exists (^) G J' such that (re,?/) = (a, J) or (x, = (c, 6). We 
denote by { J c \ C G C} the set of equivalence classes in J . Then the class J c has the 
following form. 

*-<©•&) (t3-(O-(0>- 

where (J) G J' for 1 < i < fc. We put 

!!><«<»}. 

where p = (resp. g = /c + 1) if there exists (^°) G J' (resp. (^*^) G J') such that 
b = c (resp. a^+i = rf), and p = l,q = k otherwise. 



MACDONALD FUNCTIONS 21 

For each C E C, we define the sets K C) K' c as follows: 




ifp= l,g = fc, 

if p = 1, g = k + 1, 
if p = 0, q = k, 

if p = 0, ? = k + 1. 



c / VOfe-2/ \Ofc-l 



if p = 


1,5 = 


fc, 




if p = 


1,9 = 




-i, 


if p = 


o,g = 


k, 




if p = 


0,5 = 


k ^ 


- i. 



Since J, J' are subsets of the index set of elements in Z, Jc, etc. induce permutations 
on the entries of elements in Z. We denote by xc,x' c (resp. yc,y'c) the permutations 
in &m corresponding to J c , J' c (resp. K C ,K' C ), respectively. Then it is easy to check 
that 

(3.10.1) x' c o x c = y c °y' c - 

We put 

K = ( J - J ) U |J K c , K> = (J' -JJ)U[J K' c . 

cec Cec 

Components of K (resp. K') are mutually disjoint, and we see that K e X r , X' e X r i. 
We now define the map ip : X r x X r > — > X r x X r / by </?(J, J') = (K, K'). Then one can 
check that ip 2 = id, and so ip is a bijection. The assertion (i) follows from (3.10.1). 
To show (ii), it is enough to verify the formula in the case where J = Jc,J' = 
J' c , K = K c , K' = K' c . The assertion is clear when K c = J' c , K' c = J C - Assume that 
p — l,q — k or p — 0, q — k + 1. Then one can check by a direct computation that 

(a, J c ) = (a K ' c , K c ), (a Jc , J' c ) = (a, K' c ) . 
Hence the formula holds in these cases also, and the lemma follows. □ 

Proposition 3.11. Assume that e = 2, and q = t. Then the operators D r (t,t) are 
commuting with each other for r — 1, . . . , M x . 

Proof. As remarked in 3.9, it is enough to show that the matrices B r T = B r j^ T are com- 
muting with each other for r = 1, . . . , M 1 . By Lemma 2.4 (i), the part corresponding 
to the diagonal block in the expression of D r (t,t)s a is given as 

Jelr 

where A = ol + 8. Let X be the part of D r> (t,t)D r (t,t)s (X corresponding to the 
diagonal blocks. Then we have 

x E t^s lAj]j „. s . 

Jelr J" ex., 
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For each J, there exists w G (5 m such that [Aj] = w(Aj) and ej is given by ej = 
Then if we put J' = w~\J"), we have ([Aj], J") = (Aj, J'), and = 
w(Ajjr). Hence one can write 

where Ej : j> = (— l)'( w ') for w' £ & m such that [Ajj/] = w'(Ajji). Now by apply- 
ing Lemma 3.10 for a. = A, we see that X coincides with the diagonal part for 
D r (t,t)D r ' (t,t)s a . The proposition is proved. □ 
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